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Method for effective utilizing of shared resources in 
computerized systems 

Field of the invention 

5 The invention relates to utilizing shared resources of a complex 

computerized system controlled by a central control unit using program 
commands. More particularly, the invention deals with a problem of 
auto-routing in telecommunication networks where the system comprises 
a considerable amount of shared resources, such as database tables 

10 (software data base resources), hardware agents or units, memory based 
repositories etc., which are accessed at various stages of the system 
operation. 

Background of the invention 

15 In multiprocessor computer systems and the like, in which systems 

utilizing different processors are simultaneously in operation, access to 
memory or other shared resources becomes complex. Since it is likely 
that each of the processors or processor systems may require access to the 
same memory simultaneously, a conflict between processors will 

20 generally be unavoidable. 

Essentially, the operation of two or more processors or processor 
systems periodically results in overlap of the memory commands with 
respect to a common memory, or other shared resource, in the 
multi-processor computer system. 

25 Conventional approaches to solving the problem of conflicting 

memory access requests to a shared memory include, in one case, 
complete redundancy of the memories used for each of the processors, 
and isolation of the processor systems. However, this approach to solving 
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the problem of conflicting memory access requests often defeats the 
intended advantage of the multiple processor system. 

Various approaches have been used to avoid the above described 
conflict problems. In one approach, the avoidance of conflicts is 
5 accomplished by sequentially operating the processors or by time sharing 
the processors. 

In this way, the processors simply "take turns" accessing the 
shared resource in order to avoid conflict. Such systems commonly used 
include passing the ring" or "token systems" in which the potentially 
10 conflicting processors are simply polled by the system in accordance with 
a pre-determined sequences similar to passing a ring about a group of 
users. 

Unfortunately, use of sequential processor access methodologies 
imposes significant limitation upon the operation of the overall computer 

1 5 system. This limitation arises from the fact that a substantial time is used 
by the system in polling the competing processors. In addition, in the case 
where a single processor is operating and requires access to the shared 
memory, for example, a delay between the processor accesses to the 
shared resource is created following each memory cycle as the system 

20 steps through the sequence. 

Another conventional approach to conflict avoidance relies upon 
establishing priorities amongst the processors in the computer system. 

One such arrangement provides for every processor having 
assigned to it a priority with the hierarchy of system importance. The 

25 memory controller simply provides access to the highest priority 
processor every time a conflict occurs. For example, in a two processor 
system, a first and a second processor access a shared memory which is 
typically a dynamic RAM (DRAM) type memory device which requires 
periodic refreshing of the memory maintain stored data. Generally, the 



DRAM type memory is refreshed by a separate independent refresh 
system. In such a multi-processor system, both the processors and the 
refresh system compete for access to the common memory. A system 
memory controller will process memory access request conflicts, or 
5 commands, as determined by the various priorities assigned to the 
processors and the refresh system. While such systems resolve conflicts 
and are somewhat more efficient than pure sequential conflict avoidance 
systems, it still suffers from lack of flexibility. 

Yet another approach to conflict resolution involves 

10 decision-making capabilities incorporated into the memory controller. 
Unfortunately, because the decision making portions of the memory 
controller are operated under the control and timing of a clock system, a 
problem arises in the substantial time is utilized in performing the actual 
decision making before the memory controller can grant access to the 

1 5 common memory. 

PCT/WO US9926994 describes a universal resource access 
controller coupled to a requesting system and a resource, such that when 
the requesting system desires access to the resource, the requesting 
system generates a resource access request which is passed to the 

20 universal resource controller. The universal resource controller, in turn, 
uses a specific characteristic operating parameter of the requested 
resource as well as a current state of the requested resource to generate a 
corresponding sequenced universal access request command suitable for 
accessing the resource as required by the requesting system. 

25 Though, in any one of the above-mentioned cases, when a specific 

shared resource is accessed during execution of a particular command, 
the resource is non-available for another command. Therefore, if a 
number of shared resources participate in executing a particular 
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command, they are all locked up while the command is completely 
executed. 

In other words, parallel processing known as a computer 
technology in which several or even hundreds processors are linked and 
5 able to work on different parts of a problem simultaneously, does not 
resolve the problem that when such "different parts of the problem" 
require one and the same resource to be utilized for their needs, one part 
of the problem should wait until the other part completes using the 
resource. 

10 Some new developments in the field have been described in the 

prior art, for example in a Japanese publication No. JP 10301608A 
"Controller for work Machine" to Yaskawa Electric Corp. The problem 
set in the JP'608A publication seems similar to that which exists in many 
modern complex systems: providing a simultaneous operation control and 

15 a partially independent operation control by distributing operation 
instructions to a prescribed actuator based on a so-called "physical axis 
constitution information" for noting the connection relation of a 
controlled system and a physical actuator. 

To solve the problem, JP'608A proposes that a work program is stored in 
20 a work program storage by using a so-called programming pendant, and 
the physical axis information is stored in a physical axis constitution 
information storage. The work program is interpreted and executed by 
respective sequence execution blocks, operation commands are prepared 
and outputted to an output area. The operation commands are 
1 25 simultaneously sent to a drive control unit assigned to a particular number 
according to the physical axis information to operate a motor. By turning 
the sequence execution blocks to multiple tasks, the execution of 
mutually asynchronous work programs is made possible. 



The Japanese publication, however, does not disclose how the sequence 
execution blocks can be turned to the multiple tasks and how the 
asynchronous operation becomes possible. 

5 Object of the invention 

It is therefore an object of the present invention to provide a 
method of controlling a computerized system having shared resources by 
enabling asynchronous execution of program commands. 

It is another object of the invention to provide a control system for 
10 accomplishing the above method. 

Summary of the invention 

In modern complex computerized systems, for example in 
telecommunication systems, the sequential use of shared resources poses 

15 a serious problem. For example, when a number of urgent commands are 
to be executed by the system, the shared resources constitute a so-called 
bottle neck, since most of them either wait when others complete their 
function, or perform operations which, though forming part of one urgent 
command, are not urgent themselves. In other words, more critical 

20 operations of another urgent command wait in the queue until the 
preceding command is completely executed by a specific shared resource. 

The above problem can be resolved and the object can be achieved, if 
in a complex computerized system having a processor for processing 
commands, and one or more shared resources (such as a number of 

25 memory units, databases, hardware units and the like) required for 
execution said commands, 

there is applied a method for effective utilizing the shared resources, 
and the method comprises steps of : 



- deriving, from each of said commands, subcommands respectively 
related to said one or more shared resources, 

- assigning priorities to said subcommands, 

- forwarding said subcommands to one or more input queues of the 
respective one or more shared resources, so that each of said input 
queues comprises the subcommands related to a particular shared 
resource, 

thereby ensuring execution of the subcommands from said queues by 
said shared resources in an asynchronous manner, and according to 
said subcommand priorities by each of the shared resources. 
For example, some of the subcommands may be considered so-called 
critical subcommands having a higher importance and thus a higher 
priority, and some of them - so-called non-critical (less important) 
subcommands having lower priorities. 

In a typical case, where there are many shared resources and more 
than one command to be executed, the method provides for simultaneous 
utilizing of said different shared resources and consequently, for 
asynchronous execution of the commands. In such a typical case, the list 
of shared resources required for execution of one command, at least 
partially overlap the list of shared resources required for execution of 
another command. However, even in a case where only one command is 
to be currently executed using one shared resource, the method still 
applies since this command may comprise a number of subcommands 
requiring utilizing of the shared resource but having "different 
importance". Even in such a case, assigning priorities to the 
subcommands would allow using the shared resource effectively, since a 
more urgent operation or a newly arriving subcommand would have a 
chance to be executed by the shared resource without waiting for the prior 
command completion. 



It should be appreciated that both the system and the method of 
utilizing the shared resources are hierarchical, and the above definition 
describes only a single but characteristic chain of the method in the 
hierarchical system. 
5 According to one of preferred embodiments of the invention, the 

complex computerized system can be a computerized system for 
controlling telecommunication networks, or a so-called 
software-hardware platform for network operation. 

In the simplest case, said processor can be understood as a central 
10 processor of the system and said commands may constitute external 
(users') requests. However, said commands may be understood as 
intermediate utilities formed from the external requests. Likewise, the 
external users' requests may preliminary be classified into categories, and 
each of the hierarchical levels (requests, categories, commands, 
15 subcommands) may be assigned their level priorities; even the shared 
resources, while executing subcommands, may perform the action in a 
similar hierarchical manner. 

Based on the above, the inventive method may additionally 
comprise a step of assigning different command priorities to said 
20 commands, wherein the command priorities set an order of their urgency. 

Similarly to that on the level of subcommands, some of the 
commands may be considered critical and thus having a higher priority, 
and some of them - non-critical commands with lower priorities. 

Returning to the characteristic chain of the method, let's discuss 
25 how the subcommands' priorities can be assigned. 

According to one version of the method, the step of assigning the 
priorities to subcommands derived from a particular command comprises 
assigning to the subcommands the priority equal to the priority of that 
particular command. 



According to a more preferred version of the method, the step 
assigning priorities to the subcommands related to different shared 
resources comprises simultaneous dividing them into a group of so-called 
critical subcommands having higher priority in the command, and a 
5 group of so-called non-critical subcommands having lower priorities in 
the command. 

In yet a further version, the step of assigning priorities to the 
subcommands will comprise assigning to each subcommand a combined 
priority; the combined priority being defined taking into account both the 
10 higher or lower subcommand's priority in the command and the priority 
of the particular command itself. 

In order to properly utilize results of the shared resources 
operation, the following further steps can be undertaken: 

- forming, for each of the shared resources, a response queue, 

15 - in each of the shared resources, upon executing the subcommands 
from the subcommand queue according to the subcommand priorities, 
obtaining respective responses and outputting thereof into the 
response queue; 

- forwarding each of the responses from the response queues to the 
20 command from which the corresponding subcommand was derived to 

create reports with respect to said commands. 

Distribution of the responses is preferably organized according to 
the FIFO principle. However, it can also be prioritized. 

Yet another characteristic feature should be mentioned concerning 
25 the method. Each of the commands, when completely executed results in 
issuing a final report, say, to the higher level of the hierarchical system. 
For the final report to be issued, responses to all subcommands of the 
command are to be received. However, when one or more said responses 
concerning one or more of the critical subcommands is received by the 



corresponding command, a report concerning execution of the critical 
part of the command (a so-called critical part report) may be preliminarily 
released. The critical part report might be important for an earlier start of 
any additional command and/or operation at a higher level or at another 
5 processor of the same level of the system. Therefore, the critical part 
report can be used for initiating various urgent actions even before the 
command that issued such a report is completely executed (i.e. when all 
its subcommands and other portions are executed). 

According to a second aspect of the invention, there is also 
10 provided a control system for effective utilizing shared resources, the 
control system comprising: 

one or more command processors for processing commands, each being 
capable of cooperating with one or more said shared resources; 
each of said command processors being operative to: 
15 - derive, from each said command, subcommands respectively related 

to said one or more shared resources, 

- assign priorities to said subcommands, 

- forward said subcommands to the respective shared resources for 
execution, 

20 - receive from said shared resources responses to the respective 
subcommands, and 

- based on responses to said subcommands, form reports to the 
respective commands. 

Preferably, the above control system for effective utilizing shared 
25 resources of a computerized system further comprises a higher level 
processor capable of cooperating with said (lower level) command 
processors; 
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said higher level processor being operative to distributive commands 
between said command processors, and receive from said command 
processors reports to respective commands. 

The higher level processor may therefore be operative to sort the 
5 commands (by categories, priorities or the like) between said lower level 
command processors. The higher level processor may therefore be 
capable of assigning priorities to said commands. Alternatively, the 
command processors receiving commands according to categories, may 
assign priorities to the commands. 

10 According to the preferred embodiment of the system, said 

command processors are capable of dividing said subcommands into 
critical subcommands having higher priorities, and non-critical 
commands having lower priorities. In yet a further embodiment, among 
the reports created by a particular command processor based on responses 

1 5 to the subcommands, there are so-called critical reports produced by the 
command processor based on one or more responses to the critical 
subcommands. Such critical reports may be used, for example, for 
beginning of urgent execution of a new command while the command 
presently under execution is still not completed. 

20 In order to enable each of said shared resources to receive and 

execute relating to it subcommands according to said priorities, and to 
output responses respectively corresponding to said subcommands for 
submitting thereof to the respective lower level command processors, 
the control system additionally comprises one or more input memory 

25 buffers respectively intended for said one or more of the shared resources, 
for gathering and queuing subcommands to be input to the shared 
resource, and respective output memory buffers for queuing responses to 
be output from the shared resources and forwarded to different lower 
level command processors. 
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Therefore, each of the lower level command processors is capable 
of simultaneously utilizing each of the shared resources by forwarding 
each of the subcommands to a particular required shared resource via its 
input buffer, and by receiving respective responses from the shared 

5 resources via their output buffers. While the subcommands are executed 
maximally in parallel by the shared resources, asynchronous execution of 
the commands is achieved. 

To ensure reading of the subcommands from the input buffers 
according to the subcommands' priorities, at least two solutions may be 

10 proposed. According to the first solution, the shared resources should be 
provided with means enabling reading the subcommands from the queue 
according to the subcommands' priorities. In the second solution, the 
input memory buffers are capable of sorting the subcommands in the 
queue so that the first subcommand to be read from the queue is always 

1 5 that having the highest priority in the queue. 

Yet another aspect of the invention is a computerized system with 
shared resources, comprising the above-described control system for 
effective utilizing said shared resources. 

20 Brief description of the drawings. 

The invention will further be described in more detail with 
reference to the following non-limiting drawings, in which: 

Fig. 1 is a schematic block-diagram of an embodiment of the 
computerized system utilizing the method according to the invention. 
25 Fig. 2 is a schematic chart illustrating a particular example of 

decomposing urgent external requests in a telecommunication system, to 
effectively utilize shared resources of the system. 
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Detailed description of the preferred embodiments 

Fig. 1 schematically illustrates a control system 10 configured for 
effectively utilizing shared resources of a computerized system. The 
control system comprises a central processor 12 (a higher level processor) 

5 connected to "n" command processors (lower level processors). Only the 
first and the "n"-th command processors are shown in the drawing and 
marked 14 and 16, respectively. The central processor 12 receives user's 
external requests 1 1 (commands), and issues replies 13 being solutions to 
the problems which the requests set. For example, the request may 

10 constitute an urgent requirement to reroute and restore a particular 
telephone call when its original path in the network failed. 

Such a request will be treated by the central processor as belonging 
to the alarms category. In terms of priorities, let this particular alarm is 
assigned the highest priority 5 in the example. CP 12 will therefore 

15 transfer the request to the command processor 16 handling a category of 
alarms. Other command processors may be intended, say, for external 
requests serving other functions and having various lower priorities. 
Each of the command processors may comprise an internal command 
queue where the commands are arranged according to their priorities. 

20 Each command processor further divides commands into a number of 
subcommands. The reason is that for performing a particular command, 
different shared resources may be required. Likewise, only particular 
fragments of the command are responsible for interaction with respective 
shared resources to provide sub-operations. It is highly desired to perform 

25 in parallel processing as many of such sub-operations as possible. 

The command which is presently under processing (say, a command 17 
identified with type 2, priority 5 in the command processor 16) is 
decomposed in the processor 16 into a number of subcommands, wherein 
each of them is executable by a particular shared resource of the 
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computerized system. In this example, the computerized system includes 
N shared resources, of which only three are shown and schematically 
marked 18, 20 and 22. Each of the subcommands has its assigned 
priority. The subcommands' priority may be equal to the priority of their 

5 mother command (as shown in Fig. 1). Preferably, the assignment is 
provided in a different way. Usually, in the frame of one command, some 
of the subcommands must be executed on the rush basis (for example, 
those responsible for finding a new route for a failed telephone call), 
while others may wait (if, for instance, they are responsible for updating 

10 databases after the action is performed); such different subcommands are 
proposed to acquire different priorities. 

Of course, a command may comprise portions (not shown) which 
do not require any shared resource for their execution. Such portions may 
(or may not) await in the command processor for responses to all other 

15 subcommands. For example, a "critical part report" may be issued by a 
command when one or more subcommands thereof, which are considered 
critical, are executed (i.e., responses to such subcommands have been 
received). In the drawing, such a report is shown as a dotted arrow 15; it 
is issued by the processor 16 before the command 17 under treatment is 

20 completed, as a result of execution of its critical subcommand related to 
the shared resource No. 2. Though in the figure the dotted arrow 15 is 
directed to the central processor 12, it should be appreciated that such a 
critical part response may be used for activating actions in other members 
of the system. A report on final execution of the command under 

25 treatment in the processor 16 is marked with a solid arrow 19, which also 
symbolize forwarding commands from CP 12 to the command processor 
16. 

Each of the shared resources is provided with two buffers for queuing. 
For the shared resource 18, there are an input buffer 24 serving for 
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subcommands queue... and an output buffer 26 serving for responses 
queue. For execution subcommands using the shared resource 18, the 
subcommands having higher priorities will be read from the buffer 24 
before subcommands having lower priorities. The responsibility of 
5 sorting the subcommands according to their priorities can be either on the 
buffer, or on the shared resource. 

The responses from the buffer 26 may also be read according to their 
priorities, for first forwarding urgent responses to the respective 
command processors and suitable commands, though the response queues 
10 may successfully be built according to the FIFO (first in, first out) 
principle. 

It is therefore understood, that the shared resources operate in 
parallel and in the most effective way, i.e., each of the shared resources is 
not locked for the complete time of execution of any command, but 
1 5 devotes to any command only the exact time required for execution one 
or more of its subcommands. Therefore, time which was wasted in the 
prior art solutions due to locking a shared resource during one command, 
now remains available for serving other commands in the asynchronous 
manner. 

20 Fig. 2 illustrates, in the form of tables, a particular example of handling 
external requests typical for controlling a computerized 
telecommunication network system. 

External requests in such a system can be broadly classified into three 
categories: 

25 Category A - the most prioritized requests concerning the network 
management, such as network topology changes, connectivity changes 
(for example, restoration of failed links, and other requests concerning 
auto-routing ). 
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Category B - moderately prioritized requests concerning network 
elements' (NE) management, such as configuration, performance, faults 
of NE. • 

Category C - less prioritized requests concerning quality of service, 
5 business issues, reporting issues, etc. 

Let, in the present example, one lower level command processor 
has almost simultaneously received from the central processor three 
external requests (commands) 30, 32 and 34 of category A, which are all 
equally urgent since all of them require restoration of a faulty path in the 
10 network. 

Let the commands arrived in the order marked as Restoration 1, 
Restoration 2 and Restoration 3. Each of them represents a maximally 
urgent external request, which, if others were absent, would acquire the 
maximal priority in the control system. 
15 The three tables under the titles "Restoration" schematically represent 
how the commands 30, 32 and 34 can be divided into respective, 
subcommands in the command processor. 

The upper three lines (n.l, n.2, n.3) in each of the tables where n=l, 2 or 
3, list subcommands which are to be executed most urgently in different 

20 shared resources of the system. The urgency is set by critical functions of 
the subcommands, since they are responsible for searching new 
substituting paths and edges presently available in the network and 
issuing orders to establish new connections. Each of the three 
subcommands n.l, n.2 and n.3 requires for its execution a different shared 

25 resource (for example, a paths database 42, an edges data base 44 and a 
connectivity data base 46). These subcommands are considered critical 
and assigned the maximal priorities (10 for n.l and n.2, and 8 for n.3). 
The lower three lines in each of the tables comprise subcommands which 
relate to updating changes introduced by the critical subcommands in the 



respective data bases (shared resources). Such subcommands, though 
must be executed, will wait until most urgent subcommands make their 
critical work. 

As proposed in the invention, the subcommands belonging to 
5 different commands are arranged in queues 36, 38, 40 of the shared 
resources respectively required for the subcommands execution, but 
according to priorities of the subcommands in the commands. 

As mentioned above, the shared resources are schematically 
marked with 42, 44 and 46; in this example they respectively represent 
10 the paths data base, the edges database and the connectivity/order transfer 
database. Each of the shared resources reads subcommands from its 
queue according to the subcommands' priorities. If there are more than 
one subcommand with equal priorities in the queue, such a group of 
subcommands are executed according to the FIFO principle. Queues of 
15 responses to the subcommands executed in the shared resources are not 
shown. 

Though the present invention has been described and illustrated 
with reference to particular examples, one should appreciate that other 
and more elaborated examples can be utilized for demonstration the 
20 principle of the invention, and that other versions of the hierarchical 
method and system may be proposed and should be considered part of the 
invention. 
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CLAIMS: „ 

1. A method for utilizing shared resources in a computerized system, 
with the aid of a processor for processing commands to be executed using 
one or more of said shared resources, the method comprising steps of : 

5 - deriving, from each of said commands, subcommands respectively 
related to said one or more shared resources, 

- assigning priorities to said subcommands, 

- forwarding said subcommands to one or more queues of the 
respective one or more shared resources, so that each of said 

1 0 queues comprising the subcommands related to a particular shared 

resource, 

thereby ensuring execution of the subcommands from said queues by 
said shared resources in an asynchronous manner, and according to 
said subcommand priorities by each of the shared resources. 

15 

2. The method according to Claim 1, further comprising a step of 
assigning different command priorities to said commands, wherein the 
command priorities set an order of their urgency. 

20 3. The method according to Claim 2, wherein the step of assigning 
priorities to said subcommands comprises assigning to them the priority 
equal to that of the command from which the subcommands are derived. 

4. The method according to Claim 1 or 2, wherein the step of 
25 assigning priorities to said subcommands comprises defining one group 
of the subcommands as critical subcommands having higher priorities, 
and another group of the subcommands as non-critical commands with 
lower priorities. 
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5. The method according to Claim 4, wherein the step of assigning 
priorities to the subcommands comprises assigning to each subcommand 
a combined priority ; the combined priority being determined based on the 
subcommand's priority in the command and the priority of said 

5 command. 

6. The method according to any one of the preceding claims, further 
comprising steps of: 

- in each of the shared resources, upon executing the subcommands 
10 from the subcommand queue according to the subcommand priorities, 

obtaining respective responses and outputting thereof into a response 
queue of the shared resource; 

- forwarding each of the responses from the response queues to the 
command from which the corresponding subcommand was derived, 

1 5 for further creating reports relating to said commands. 

7. The method according to Claim 6, further comprising a step of 
issuing a critical part report from a particular command before 
completing its execution, but upon receiving by the command of one or 

20 more said responses concerning the respective subcommands having high 
priority, to initiate urgent execution of another command or operation. 

8. A control system for utilizing shared resources, the control system 
comprising one or more command processors for processing commands, 

25 each being capable of cooperating with one or more said shared 
resources; 

each of said command processors being operative to: 
- derive, from each said command, subcommands respectively related 
to said one or more shared resources, 
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- assign priorities to said subcommands, 

- forward said subcommands to the respective shared resources for 



execution, 

- receive from said shared resources responses to the respective 



5 



subcommands, and 



- based on responses to said subcommands, form reports to the 
respective commands. 

9. The control system according to Claim 8, further comprising a 
10 higher level processor capable of cooperating with said command 

processors; 

said higher level processor being operative to distribute the commands 
between said command processors, and receive from said command 
processors reports to respective commands. 

15 

10. The control system according to Claim 9, wherein the higher level 
processor is operative to sort the commands by priorities between said 
command processors. 

20 11. The control system according to any one of Claims 8 to 10, 
wherein said command processors are capable of dividing said 
subcommands into critical subcommands having higher priorities, and 
non-critical commands having lower priorities. 

25 12. The control system according to Claim 11, wherein at least one of 
said command processors is capable of issuing a critical part report based 
on one or more response to the critical subcommands of a particular 
command, said critical part report being issued before the particular 
command is completely executed. 
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13. The control system according to any one of Claims 8 to 12, 
additionally comprising 

one or more input memory buffers respectively associated with said 
5 one or more of the shared resources, for gathering and queuing 
subcommands to be input to the shared resource, and 

one or more output memory buffers for queuing responses when 
outputted from the respective shared resources. 

10 14. The control system according to Claim 13, wherein said input : 
memory buffers are capable of sorting the subcommands in the queue so 
that the first subcommand to be read from the queue is always that having 
the highest priority in the queue. 

1 5 15. The control system according to any one of Claims 8 to 14, being a 
system for controlling a telecommunication network. 

16. A computerized system with shared resources, comprising the 
control system according to any one of Claims 8 to 15. 
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